Massively paralellel https://en.wikipedia.org/wiki/Massively_parallel See Sanford2024transformers for the connection to the Transformer model.